Smoothing spline Gaussian regression: more scalable computation via efficient approximation
نویسندگان
چکیده
Smoothing splines via the penalized least squares method provide versatile and effective nonparametric models for regression with Gaussian responses. The computation of smoothing splines is generally of the order O.n3/, n being the sample size, which severely limits its practical applicability. We study more scalable computation of smoothing spline regression via certain low dimensional approximations that are asymptotically as efficient. A simple algorithm is presented and the Bayes model that is associated with the approximations is derived, with the latter guiding the porting of Bayesian confidence intervals. The practical choice of the dimension of the approximating space is determined through simulation studies, and empirical comparisons of the approximations with the exact solution are presented. Also evaluated is a simple modification of the generalized cross-validation method for smoothing parameter selection, which to a large extent fixes the occasional undersmoothing problem that is suffered by generalized cross-validation.
منابع مشابه
Efficient computation of smoothing splines via adaptive basis sampling
Smoothing splines provide flexible nonparametric regression estimators. However, the high computational cost of smoothing splines for large datasets has hindered their wide application. In this article, we develop a new method, named adaptive basis sampling, for efficient computation of smoothing splines in super-large samples. Except for the univariate case where the Reinsch algorithm is appli...
متن کاملNORGES TEKNISK-NATURVITENSKAPELIGE UNIVERSITET Approximate Bayesian Inference for Latent Gaussian Models Using Integrated Nested Laplace Approximations
We are concerned with Bayesian inference for latent Gaussian models, that is models involving a Gaussian latent field (in a broad sense), controlled by few parameters. This is perhaps the class of models most commonly encountered in applications: the latent Gaussian field can represent, for instance, a mix of smoothing splines or smooth curves, temporal and spatial processes. Hence, popular smo...
متن کاملUse of Two Smoothing Parameters in Penalized Spline Estimator for Bi-variate Predictor Non-parametric Regression Model
Penalized spline criteria involve the function of goodness of fit and penalty, which in the penalty function contains smoothing parameters. It serves to control the smoothness of the curve that works simultaneously with point knots and spline degree. The regression function with two predictors in the non-parametric model will have two different non-parametric regression functions. Therefore, we...
متن کاملPenalized Regression with Model-Based Penalties
Nonparametric regression techniques such as spline smoothing and local tting depend implicitly on a parametric model. For instance, the cubic smoothing spline estimate of a regression function based on observations ti; Yi is the minimizer of P(Yi (ti))2 + R ( 00)2. Since R ( 00)2 is zero when is a line, the cubic smoothing spline estimate favors the parametric model (t) = 0+ 1t: Here we conside...
متن کاملAn Assessment of Bayesian Inference
A Monte Carlo study is performed to assess the properties of a Bayesian procedure for inference in nonparametric regression with a binary response variable. The logodds (logit) of the probability of the response is modeled as an integrated Wiener process. This leads to a generalized smoothing spline as the posterior mode. Such priors have been used by many authors for nonparametric regression w...
متن کامل